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1 Introduction 

In this paper, we study dynamical systems with an infinite number indistinguishable par¬ 
ticles on a d-dimensional torus T'’*. We extend and apply methods from the Weak KAM 
theory [T6l |20l [181 [13 EHl EB ESI EH HU [6l[71[5l [29l |30l [33 [32] to the infinite-dimensional 
setting using a random variables’ approach. In particular, we prove that the infinite¬ 
dimensional cell problem admits a viscosity solution that is a fixed point of the Lax-Oleinik 
semigroup. Furthermore, we construct invariant subsets and invariant minimizing mea¬ 
sures under the Lagrangian dynamics. Finally, we obtain the existence of calibrated curves 
defined on M. 

Infinite-dimensional systems {infinite systems for short) arise in the study of mechan¬ 
ical systems with a large number of identical particles (e.g. fluids and gases). In these 
models, the number of particles is infinite and the state of the system is determined by a 
probability measure or, alternatively, by a random variable. The evolution of the system 
is characterized by an ODE in the space of probability measures or the space of ran¬ 
dom variables. A well-known example of such an ODE is the non-linear Vlasov system 

[I21[IS1I3S1E51E3EB|. 

In the seminal papers [261 E3, Gangbo and Tudorascu introduced and developed the 
weak KAM theory for infinite systems. Next, they considered an infinite system of parti¬ 
cles on the torus and modeled it using L^([0,1]) functions as random variables. They 
introduced the infinite-dimensional torus and proved a Weak KAM theorem on it. Sub- 
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sequently, in [28], these authors addressed the higher-dimensional case on the torus T'^ 
for d > 1. This case is studied using probability measures over They generalize core 
aspects of the one-dimensional problem to higher dimensions. 

In laiiKinKii], Bessi examined infinite systems in the framework of the Aubry-Mather 
theory. In particular, in [9|, the author studied the Aubry-Mather minimal measure theory 
in the inhnite-dimensional setting for d= 1. 

Crucial aspects of the previous results are the following. Firstly, in the one-dimensional 
case, the existence of optimal trajectories is proved for monotone and square integrable 
initial conhgurations of particles. This technique is used to overcome the fact that T^([0,1]) 
is not locally compact. Monotonicity yields compactness, and that makes it possible to 
extend finite-dimensional methods. Unfortunately, this technique does not generalize to 
higher dimensions. 

Secondly, in prior publications, the higher-dimensional case was studied via the proba¬ 
bility measures approach. The space of probability measures is a metric space, and it does 
not have a natural linear structure. This fact creates additional difficulties. A standard 
solution to define the velocity of a curve is to consider velocity fields of minimal norm 
[T]. As pointed out in [28] . this is not the suitable notion to develop the Weak KAM on 
the space of probability measures. The appropriate derivatives are the c-minimal velocity 
fields. However, these depend on the choice of c € Therefore, the definition of the 
viscosity solution of the cell problem depends on c. 

Thirdly, for any dimension d > 1, there exist weakly invariant minimizing measures 
(or minimizing holonomic measures) [261 128] . Moreover, if d = 1 there exist invariant 
(or strongly invariant) minimizing measures [^. The existence of invariant minimizing 
measures in the case d > 1 was not settled previously. 

Finally, the Lagrangians considered in previous publications are mechanical Lagrangians 
that are the sum of kinetic and potential energy. 

In this paper, we contribute to the existing results in several directions. For any 
dimension d > 1, we address the following points: 

i. For any c € and for generic initial configurations of the particles, we prove the 
existence of the optimal trajectories for the discounted cost infinite horizon problem. 

ii. For any c G we prove that the infinite-dimensional cell problem admits a vis¬ 
cosity solution U and that this solution is a fixed point for Lax-Oleinik semigroup. 
Moreover, we show the existence of ([/, c, L)-calibrated curves defined on M"*“, where 
L is the Lagrangian of the system. 

iii. We show the existence of invariant minimizing measures and (JJ, c, L)-calibrated 
curves defined on M. 

iv. We consider general Lagrangians (i.e., infinite-dimensional Tonelli Lagrangians). 

In what follows, we present the statements of our main results and give a detailed 
description of our methods. 
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1.1 Main results and the outline of the paper 


Let I = [0,1]'^ and Aq be the Lebesgue measure restricted to I. A curve cr ; (0, T) —)• 
t !-)■ at, is absolutely continuous if there exists (3 E L^(0, T) such that 

j3{u)du, (1-1) 

for every s < t in (0,T). We denote by AC^(0, T; L^(/; M'^)) the set of all absolutely 
continuous paths a : (0,T) —)■ such that there exists (3 E L^(0,T) satisfying 

(jl.ll) . The set ACf^Jy^,oo\L?{r,W^)) is the set of curves a : (0,oo) —)• whose 

restriction to (0,T) is in AC^(0, T; L^(I; R'^)), for all T > 0. 

In this paper, we assume that the Lagrangian L : L^(/;R'^) x L^(/;R'^) —>■ R satisfies 
the conditions i) — viii) given in Subsection [231 An important example that satishes these 
conditions is the mechanical Lagrangian 

L{M, N) = - [ W{M{z) - Miz))d\oiz)dXoiz), 

^ Jlxl 

where W E C^(T'^) is an interaction potential. 

In Section [31 we consider the discounted-cost infinite-horizon problem. For c E R'^, we 
set 

LciM,N)=L{M,N) + J^c-NdXo- (1.2) 

We fix e > 0, and for a trajectory x E AC^^^((0, oo); L^(/; R'^)), we define the action 

roo 

Asix) := / e~^^Lc{x,x)dt. 

Jo 

Since Lc is bounded by below, As is well defined. Set 

K(M) := inf{Al,(x) : x E ACL((0, oo); L2(/; R'^)), x(0) = M}. (1.3) 

X 



The Hamiltonian is the Legendre transform of L given by 

H{M,P)= sup {-{P,N) - L{M,N)}, (1.4) 

AfeL2(/;Md) 

for {M,P) E L^(/;R'^) x L^(/;R'^). The Hamiltonian Pic associated with Lc is given by 

Hc{M,P) = H{M,P + c). 


We have that (see na 133 ini ESI [9]) 14 is a viscosity solution of 

eVeiM) + Hc{M, VVe{M)) = 0. (1.5) 


Our first result is: 
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Theorem 1.1. For every differentiability point M ofVs, there exists a unique minimizer 
X* G ([0, oo), L^(I; M'^)) of (11.31) with the initial condition a;*(0) = M. Furthermore, 
a;*(0) = —DpHc{M,'S/Ve{M)) and x* solves the Euler-Lagrange equation, that is 

To date, the existence of the minimizers for higher dimensions has been an open prob¬ 
lem (see Remark 3.4 in [2S]). Our proof is based on the techniques that we developed 
regarding the existence of minimizers of the optimal control problem in Hilbert spaces 

1351ES]. 

In Section m we present the proofs of our main results. Firstly, we extract a convergent 
subsequence out of the family of the functions {eI4} and {17^ := 14 — inf 14 } 

- Hlc) = lim eI4, U = lim U^. (1.6) 

£ —^0 £—^0 

We prove the following theorem. 

Theorem 1.2. Let U and H{c) he given by (11.61) . Then U is a viscosity solution of the 
equation 

H,{M,VU) = H{c). 

Additionally, for every differentiability point M G L^(I;M'^) ofU, there exists a unique 
trajectory x* G (^^([O, oo); L^(I; M'^)) whose restriction to the interval [0,T] is a minimizer 
of ^ 

[/(M)=inf{/ Lc{x{s),x{s))-\-H{c)ds-\-Lf{x{f));x{{)) = M}, (1-7) 

Jo 

for any T > 0. The infimum is taken over the curves in T); L^(/; R*^)). Moreover, 

X* satisfies the Euler-Lagrange equation 

-^DMx*,x*) = D,L,ix*,x*), 
ds 

with a;*(0) = M and x*{0) = —DpHc{M,'VU{M)). 

Our next key result is: 

Theorem 1.3. For any c G R'^, there exists a closed infinite-dimensional subset Ll of the 
tangent bundle TLfi{L]Mf) that is invariant under the Euler-Lagrange flow (1^ . 


As corollaries to this Theorem, we get: 

Corollary 1.1. Eor any c G R'^, there exist {U, c, L)-calibrated curves x G AC^(R, L^(/; R'^)), 
that is, (031) holds. 

Corollary 1.2. For any c G R'^, we have 


—H{c) = inf 
u 


Lcdp, 


n 

where the infimum is taken over all invariant probability measures p, on (H, 53). Moreover, 
the infimum is achieved. 
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Remark 1.1. is the a-algebra of subsets of it that are closed under measure-preserving 
transformations and integer translations. See (iZl) for the definition. 

Thanks: We thank Wilfrid Gangbo for his valuable comments on this manuscript. 


2 Preliminaries and main assumptions 

Here, we present background material on mechanical systems with finite or infinite number 
of identical particles. 

2.1 Mechanical systems with a finite nnmber of indistinguishable parti¬ 
cles 

Consider a system of n identical particles on the torus T*^. Let I : x —>■ R 

be the corresponding Lagrangian. Denote by Xi(t) € R the position of the particle ”z” at 
time t. Let be the corresponding initial position and velocity. From Hamilton’s 

minimal action principle, the system evolves according to the Euler-Lagrange equation: 

f Tt^vKx{t),x{t)) = DJ{x{t),x{t)), ^ 

|xi(0) = x°, Xi{H)=v^, i = l,2,...,n, 

where x{f) = {xi{f), X 2 {t), ■ ■ ■ ,Xn{t)) € (R'^)"'. Let h : (R'^)” x R be the Hamil¬ 

tonian given by the Legendre transform 

h{x,p) = sup {—p-v — l{x,v)}. 

Then, (12.ip has the equivalent formulation in Hamiltonian form 

x{t) = -Dph{x{t),p{t)), 

< p{t) = D^h{x{t),p{t)), (2.2) 

_Xi(0) = x°,i;i(0) =p°, z = l,2,...,n, 

where p{t) = {pi{t),P 2 {t), ■ ■ ■ Pn{t)) G (R*^)” is referred to as the momentum. 

A critical issue in classical mechanics is the study of qualitative properties of (|2.ip and 
Since the particles move on the torus T'^, we assume that I (and, consequently, h) 
are periodic in the position variable, x. Because the particles are identical, I and h are 
invariant under permutations, that is, for all points {xi, Vi) G R'^ x R'^, i = 1,2, • ■ ■ , n and 
all permutations a € Sn, 


/(xi,X2,’‘* , Xn,V\,V2, ‘ ‘ ‘ Vn) ^(^(t(1) ? ^(t( 2) ; ’ * * ? ^(T(n); ^a'(l) ? ^(t( 2) ? * * * ^cr(n) ) 

h(^X\ , X2, * * * , X^n , V\ , V2 , ‘ * * Vn') ^(^(t( 1) ; ^cr(2) ? * * * ; ^(T(n) ? ; ^cr(2); * * * ^(T(n) ) • 

Then, (|2.1I) and (|2.2I) can be viewed as dynamical systems on (T'^)”/S'n. 
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Graphs of closed one-forms that lie in the level sets of the Hamiltonian are invariant 

_ n 

under the flow (j2.2l) . Since closed forms on (T'^)”'/5n are given by (jJx{p) = c ■ pi + 

i=l 

{Du{x),p), for some c and u : M periodic, we are led to the equation 

h{x, Du{x) + c) = X, (2-3) 

where A G M is a constant, and c = (c, c, • • • , c) G Equation (|2.3I) is the cell problem 

associated with (12.2p . 

Qualitative properties of (|2.ip and (|2.2p are closely linked to the regularity properties 
of the solutions to (|2.3p . 

2.2 The random variable approach 

A standard method for studying mechanical systems with an infinite number of identical 
particles is to look at a probability measure encoding the positions of the particles. The 
evolution of a system is a curve in a space of probability measures. For problems with a 
finite number of particles, this measure is the empirical measure of the particles’ positions. 
If the ambient space is compact, the space of probability measures on it is also compact. 
Compactness is particularly relevant for a variational theory such as the Weak KAM 
theory. On the other hand, the lack of a linear structure makes it more complex to 
introduce notions such as the derivative of a path. 

An alternative approach consists of regarding the state of the system as a random 
variable. Each realization of this random variable represents the position of one particle. 
The evolution of the system is given by a trajectory in a space of random variables. The 
space of random variables is a vector space and has a natural Riemannian structure. Un¬ 
fortunately, in contrast to the space of probability measures, non-trivial spaces of random 
variables are not locally compact. However, for symmetrical problems, random variables 
that have the same law represent an equivalent state of the system. Thus, the dynamics 
can be viewed as an evolution in the quotient space of random variables with respect to the 
equivalence relation of having the same law. This latter space is compact and isometric 
to the space of probability measures [28]. Hence, we can use compactness arguments. 

In [261127] the random variables approach is used by working in T^([0,1], M). Let R 2 (IR) 
be the space of probability measures over R with finite second-order moment endowed 
with the 2-Wasserstein distance IT 2 . Then, 'P 2 (^) is isometric to the set of monotone 
non-decreasing functions in T^([0,1],R). The lack of compactness of L^([0,1],R) is offset 
by the compactness of the set of monotone functions via Helly’s selection theorem. 

If d > 1, the random variables approach leads to a dynamical system on L^(/;R'’*), 
where I = [0,1]'^. Unfortunately, unlike in dimension 1, there is no canonical isometry 
between 7^2(1^'^) and some subset of L^(/;R'^). Hence, the methods used in |261|27| can¬ 
not be applied if d > 1. In particular, the existence of minimizing curves for both the 
discounted infinite horizon problem and the Lax-Oleinik semigroup were open until now. 
In this paper, we prove the existence of minimizers in the general case d > 1. In |28j . 
the authors use an alternative approach and work directly in V{T'^). Our techniques are 
more functional analytic in spirit, and use results from the calculus of variations in Hilbert 
spaces [33] . 
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2.3 Mechanical systems with an infinite number of indistinguishable 
particles via random variables 

Consider a mechanical system with an infinite number of identical particles. Assume that 
there is a one-to-one correspondence between particles and points in I = [0,1]'^. We encode 
the positions of the particles in a random variable M G Using the notation of 

[MIEZ], for each point z € I, Mz € is the position of the particle ”z” in the space. 

Let L : x ^ M be the Lagrangian of the system. The associated 

dynamics is given by the Euler-Lagrange equation 

f = D^L(x(t), 

\x(0) = M,i(0) = AT, 

where the partial derivatives are in Frechet sense, and (M, N) G L^(/; x L^(/; is the 
initial configuration of positions and velocities. For H as in (|1.4p . the infinite-dimensional 
Hamiltonian system is then 

'±{t) = -DpH{x{t),p{t)), 

< p(t) = D^iL(x(t),p(t), (2.5) 

,x(0) = M, p(0)=P. 

As in the finite-dimensional case, we need the notions of “periodicity” and “invari¬ 
ance under permutations” for the Lagrangian and Hamiltonian. Consider the subset of 

:= {M G ; Mz G Z"*, Aq a.e.}. 

This set is a subgroup with respect to addition. A function F defined on is 

called periodic if F{M + Z) = F{M) for all M G and Z G Periodicity 

of the Lagrangian L in the spatial variable means that 

L{M + Z,N) = L{M,N), 

for all M,N G and Z G L^(/;Z'^). The d-infinite-dimensional torus is the 

quotient space 

:= L‘^{F,R^)/L^{F,Z^). 

Let (A, 5^) and (T, 6) be measurable spaces, and M : (A, 5^) (T, ©) a measurable map. 

Suppose /U is a measure on (X,^). The push-forward of the measure /i through the map 
M is the measure u = on Y given by v[C] = ^[M~^{C)] for all sets C G 6. 

Consider the set Q of all bijective functions G : I ^ I such that G and G~^ are Borel 
measurable and that push-forward the Lebesgue measure Aq to itself. Then Q, equipped 
with the composition operation, is a non-commutative group that plays the role of Sn in 
the infinite-dimensional setting. Hence, invariance under permutations of the Lagrangian 
L in the infinite-dimensional setting is the invariance under the action of Q: 

L{M oG,NoG) = L{M, N), 

for all M, N G L^(/;R'^) and G ^Q. We call this property rearrangement invariance. If L 
is periodic and rearrangement invariant, the Euler-Lagrange equation (12.41) is a dynamical 
system on the d-infinite-dimensional symmetrical torus T'^/Cy. 
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A thorough analysis of the symmetrical torus jQ can be found in [26] {d = 1) and 
in [25] {d > 1). Here, we recall several important facts that we require for our analysis. 

We endow T'^/Q with the induced metric disti^eafc defined as 

dist^eafc(Mi,M 2 ) = inf \\Mi - M 2 o G - Z\\. 

G£g,zeL^{i-,zd) 

This distance satisfies all the axioms of a metric distance except the non-degeneracy, that 
is, there exist Mi, M 2 G such that distweakiMi, M 2 ) = 0 but Mi 7 ^ M 2 . 

We define an equivalence relation as follows: Mi, M 2 G are equivalent, de¬ 

noted by Ml M 2 , if 

disWafc(Mi,M2) = 0. 

It is straightforward to see that ~ is an equivalence relation. Define SS'^ as 

Sgd ^ I ^ _ 

iS'5'^ is a metric space with the induced distance 

distss{Mi,M2) = dist^eak{Mi,M2). 

Remark 2.1. By the abuse of notation, we denote by M all equivalence classes of M. 

Proposition 2.1 ( [26l [28] i. The spaee {SS^, distss) is isometric to {V{T‘^),W 2 ), where 
W 2 is the 2-Wasserstein distance. Consequently, SS^ is a compact, complete, separable 
metrie space. 

Furthermore, for any eontinuous periodie funetion, F : —>■ M, the following 

assertions are equivalent: 

i) F is rearrangement invariant 

ii) F{Mi) = F{M 2 ) for all Mi, M 2 G L^{F,R‘^) sueh that Mi ~ M 2 . 

Finally, we set 

vr : ^ 55'^ (2.6) 

to be the natural projection that maps a function M to its equivalence class. Note that vr 
is 1-Lipschitz. 

2.4 Main assumptions 

Here, we suppose that L : x —>■ M satisfies the following conditions, for 

some constants C,Kl,'-^ > 0 and for all M, N, Hi, H 2 G G gG, Z G L‘^{F,I/‘), 

i) L{M + Z,N) = L{M,N) (periodicity); 

ii) L{M o G,N o G) = L{M, N) (rearrangement invariance); 
hi) L > 0; 
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iv) L is Frechet differentiable and L, DL are locally uniformly continuous, where DL 
is the full derivative of L in Frechet sense; 

v) L{M,N) < C(1 + ||M||2 + IliVf), |L(M,0)| < C; 

vi) IIDLII <C + CL- 

vii) L(M + Hi,N + H2) - L{M, N) - {D^L{M, N), Hi) - {D,L{M, N), H2) > 711^2f - 

viii) L{M + Hi,N + H 2 )-L{M,N)-{D^L{M,N),Hi)-{D^L{M,N),H 2 ) < + 

For c G let Lc be as in mi- The Hamiltonian, H, associated with the Lagrangian, 

L, is given by dm). We refer to the second variable of the Hamiltonian, P, as the 
momentum variable. Differentiation with respect to the momentum variable is denoted 
by Dp. Differentiation with respect to the first variable M is denoted by Dx- 

Assumptions i)-viii) yield that H is in Frechet sense, strictly convex, and coercive. 
Furthermore, 

L(M, N) = sup{-(P, N) - H{M, P) ] P e L^{I] (2.7) 

Let N and P be the maximizers in (11.41) and (|2.7p . Then, they are related by the Legendre 
transform (which is one-to-one from L^(/;E‘^) to itself) 

P = -DxL{M,N), N = -DpH{M,P). (2.8) 

For N and P satisfying (|2.8|) . we have 

DxH{M,P) = -DxL{M,N). 

These duality statements can be found in [25], in the finite-dimensional case. Similar 
techniques apply to the infinite-dimensional case. 


3 The discounted-cost infinite-horizon problem 

In this section, we study the discounted-cost infinite-horizon problem. As is standard in 
Weak KAM theory, this problem can be used to build solutions to the cell problem [39]. 

Recall that a function taking values on EU {± 00 } is proper if it is not identically ± 00 . 

Definition 3.1. Let V : L^(/;E‘^) —)■ E U {± 00 } be a proper function and M G L^(/;E'^) 
be a point in its domain. Then, a vector G L^(/;E'^) 

i) is a subdifferential of V at M ifV{M + X) > V{M) -|- {i,X) -|-o(||X||); 
a) is a superdifferential ofV at M, ifV{M -|-X) < V{M) -|- {ffX) -|-o(||X||). 

The set D~V{M) (resp. D~^V{M)) is the set of subdifferentials (resp. superdifferentials) 
at M. 
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Remark 3.1. If the sets D V{M) and D'^V{M) are simultaneously non-empty, then V 
is differentiable at M and D-V{M) = D+V{M) = {VV{M)}. 

Let F : L^(/; xRxL^(/; ^ M be a continuous function. Consider the first-order 
infinite-dimensional partial differential equation 

F{M,V,VV{M)) =0. (3.1) 

Definition 3.2. A continuous function V : ^ M is a 

i) viscosity subsolution for (j3.ip if F{M,V{M)X) < 0 , for all M G and all 

C G D+V{M); 

ii) is a viscosity supersolution for (13.ip if F{M,V{M)X) > 0, for all M G 
and all C G D-V{M); 

Hi) is a viscosity solution for (IMI) if V is both a subsolution and a supersolution for 

(EU). 

Let Vs be the discounted value function given by Since the Lagrangian Lc is 

rearrangement invariant and periodic in the spatial variable, so is the value function Vs- 

We collect several elementary properties of the value function Vg in the following propo¬ 
sition. 

Proposition 3.1. For any t > 0 and M G we have that 

Ve{M) = inf{ f e-^^Lc{x, x)ds + e-^%{x{T));x{0) = M}. (3.2) 

Jo 

Furthermore, is a viscosity solution of the Hamilton-Jacobi equation (II3]). 

Moreover, 

i) The family of functions {eVs} is uniformly bounded. 

ii) For every e > 0 the function is Lipschitz continuous with Lipschitz constant 
independent of £. 

in) For every e > 0 the function Vs is semiconcave. 

Proof. In the finite-dimensional case, these facts are standard and are discussed, for in¬ 
stance, in [SSIEIII]. In the infinite-dimensional setting, the same methods can be applied 
without changes. Properties of the value function are examined, in the context of viscosity 
solutions, in [laiMlliniElESlES]. ■ 

Corollary 3.1. The superdifferential is nonempty at every point M G L^(/;M'^). 

Besides, is Frechet differentiable on an everywhere dense Gs set. 
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Proof. A convex function on a Banach space has a non-empty subdifferential at every 
point where it is finite and continuous m- Moreover, if the Banach space is also a strong 
differentiability spaee [2j , then every convex function defined on it is Frechet differentiable 
on a Gs dense subset of its domain of continuity. is a strong differentiability 

space (Theorem 1, [2])- Furthermore, I 4 is semiconcave, finite and everywhere continuous. 
Accordingly, D^VffM) 0 for all M G and I 4 is Frechet differentiable on a Gs 

dense subset of ■ 

In [26], the authors proved that, in the one-dimensional case, when M is monotone 
non-decreasing, admits a minimizer in L‘^{I)) that satisfies the Euler- 

Lagrange equation. Here, we establish the existence of minimizers on an everywhere dense 
Gs subspace of L^(/;R'^), for any d>l. 

Next, we detail the proof of the main result of this section. Theorem 11.11 

Proof of Theorem \1.1[ In |33| , we studied the finite horizon optimal control problems in 
Hilbert spaces. We proved that at every point of differentiability of the value function, 
there exists a unique G^ minimizer (Theorem 6.2, |33]1. Since the infinite horizon problem 
can be seen as a finite horizon one, the existence of x* is a direct consequence of that result. 
It is also standard that minimizers solve the Euler-Lagrange equation (jl.ip [38j . ■ 


4 The infinite-dimensional weak KAM theory 

In this section, we prove our main results: Theorem 11.21 Theorem 11.31 Corollary 1.1, and 
Corollary 1.2. 

Closed one-forms on T'^/Q are given by DU cxi, for some periodic function U : 
L^(/;R'^) — >■ R and some c € R*^ [26l|28]. Hence, the cell problem associated with (|2.4I1 is 

H{M,DU + cxi) = \ (4.1) 

where A € R. Moreover, as stated in Theorem 11.21 for every c G R*^ there exists a unique 
number \ = H[c) such that (14.ip has a periodic rearrangement invariant viscosity solution 
U. In Proposition 14.21 we prove that this solution is a fixed point of the Lax-Oleinik 
semigroup, that is, 

U(M)= inf / [ (Lc(x(s),x(s)) + ff(c)) ds + U(x(ti)); x(t) = M 

(4.2) 

for any M G L^(/;R'^) and t < ti. The case d = 1 was studied in |26l [27|, in a slightly 
weaker form in what concerns the Lax-Oleinik semigroup. Analogous results are available 
on the space of probability measures in [28] . 

Additionally, we show that U is semiconcave, and hence Erechet differentiable on a Gs 
everywhere dense set fProposition 14.3P . Purthermore, at differentiability points M of U, 
the infimum in (14.2p is attained at a G^ minimizer lTheorem ll.2p . This issue was settled 
for d = 1 in [26] using different ideas, and the higher-dimensional case was not addressed 
there. A corresponding result on the space of probability measures can be found in [28]. 
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A curve x : L^(/;R'^) is called a {U,c,L)-calibrated curve if 


t^(x(/3)) - t/(x(a)) = f (Lc(x(s),x(s)) +iJ(c)) ds 


for all a, jd £ [fo, ti]. Here, we prove that for any differentiability point M of 17 there exists 
a calibrated curve defined on [0, oo) starting at M. 

4.1 The cell problem: existence of solutions and elementary properties 

We begin by considering the limit as e ^ 0 of the solutions Vs to (|1.5D . 

Proposition 4.1. Let e > 0 and be a solution to (11.511 . Define Us '■= Vs — inf I 4 . Then 

i) the function Us is rearrangement invariant for every e > 0. Furthermore, the family 
of funetions {Us} is uniformly Lipschitz continuous. 

a) The family of functions {Us} has a uniformly convergent subsequence with a Lipschitz 
continuous limit U. Additionally, the family of functions {eVs} has a uniformly 
convergent subsequence with constant limit depending on c: —H{c). 

Remark 4.1. A priori, the constant limit of the convergent subsequence of the {cVs} is not 
unique, and Proposition 14-31 is valid for any such limit and corresponding limit function 
U. However, it is simple to check fhat dl.Tp implies the uniqueness of such a constant. 
Hence, H{c) is uniquely determined by the vector c G 

Proof. The family of functions V^ is equilipschitz (Proposition [3T]), thus, the family [4 is 
also equilipschitz. 

The Lagrangian Lc is rearrangement invariant hence I 4 and U^ are also rearrangement 
invariant functions. By Proposition 12.11 we may identify 14 and I 4 with functions on S'^. 
Since is a compact metric space, t4 reach their minima that are 0. Furthermore, since 
they are uniformly Lipschitz, we obtain that {U^} is bounded equicontinuous family of 
functions on the compact space S^. Therefore, by the Arzela-Ascoli Theorem, we conclude 
that it has a uniformly convergent subsequence. The limit U is also Lipschitz continuous. 

From Proposition 13. 11 we have that {el4} is a uniformly bounded and equicontinuous 
family of functions. Hence, by the Arzela-Ascoli theorem, we obtain that it has a uniformly 
convergent subsequence. The limit of this subsequence has Lipschitz constant 0, which is 
a constant function. ■ 

Proposition 4.2. For any t>0 and any M G U solves (11.711 . 


Proof. Fix any M G L^(I; M^). We claim that for any x G AC'^((0, t); L^(I; M^)) such that 
x(0) = M, 


From (|3.2|1 . we have that, for every e > 0, 



(4.3) 
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Because = V^ — inf T4 > we have 

Ue{M) < f e“^^Lc(x(s),x(s))<is + C4(x(i)) + {e~^* - l)K(x(t)). 

Jo 

Passing to the limit when e —>• 0 and using Proposition 14.11 we obtain (j4.3|) . 

Next, we prove the opposite inequality. Fix M € t > 0. Choose a sequence 

{Sn > 0} converging to 0. Let {x„} be a sequence of curves that satisfy 

ft 1 

/ e"^'‘®Lc(x„(s),x„(s))fis + + -. 

Jo n 

The previous inequality can be rewritten as 

(Lc(Xn,X„) + H{c)) ds + Ue^{Xn{t)) + I + J < Ue„{M) + 

^ n 

where 

= fo - l)Lc(x„,x„). 

Thus, if we show that I, J —> 0, we are done. Due to ProDosition l4.ll I —> 0 . Assumptions 
v)-vii) guarantee that Lc is bounded by below. Since adding a constant to Lc in J does 
not change the limit, we can assume that Lc > 0. Hence, 



because the sequence Jq e '^"^Lc(x„, x„) is bounded. ■ 

The function U enjoys properties analogous to the ones satished by 14, namely: 

Proposition 4.3. U : —>■ M is semiconcave. Furthermore, U : ^ R 

has non-empty superdifferential D~^U{M) at every point M € L^(/;R'^), and it is differ¬ 
entiable on an everywhere dense Gs set. 

We now gather the previous results and present the proof of Theorem 11.21 

Proof of Theorem li.gl The proofs of Proposition 13.11 and Theorem 11.11 apply without sub¬ 
stantial changes due to Propositions 14.1114.21 and 14.31 ■ 

4.2 Existence of an invariant subset 

A trajectory x G L^(/; R'^)) is called a two-sided minimizer (or two-sided {U, c, L)- 

calibrated curve) if 

U{^{ti))=[ {Lc{^{s),±{s)) + ff{c)) ds-^U{^{t 2 )), (4.4) 

Jti 

for all —oo < ti < t 2 < oo. 

We proceed by proving some preliminary lemmas. 
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Lemma 4.1. Let F : be a periodic and rearrangement invariant function. 

Suppose Ml is a Frechet differentiability point of F and M 2 ~ Mi. Then F is Frechet 
differentiable at M 2 and VF(Mi) ~ VF{M 2 ). 

Proof. The proof of this lemma can be found in lectures by P.-L. Lions on mean-field 
games at College de France [351II3]. ■ 

Let D C Lf{F,'Sf) be the differentiability set of the function U. Denote by V := 
{{M, S/U{M))] M G D} the graph of the gradient of U. 

By Theorem 11.21 for every point M ^ D, there exists a unique trajectory x that 
minimizes (1121). Consider the adjoint variable p(s) = —DyLc{x{s),ic{s)),s > 0. The 
trajectory (x(s),p(s)) C T*L‘^{F,'Mf) solves 

fx =-DpMe(x,p), 

|p = 

with initial data (x(0),p(0)) = (M, VC/(M)). 

On the other hand, if (x, p) satishes (14.Sp with initial data (x(0), p(0)) = (M, VC/(M)) G 
P, then X solves the Euler-Lagrange equation Z/xTc(x, x) = ^Z/„Lc(x, x) with initial con¬ 
ditions x(0) = M, x(0) = —DpHc{M,VU{M)). Therefore, by Theorem 11.21 x is the 
unique minimizer in dLZI). 

Define Vt C as the set of all points {M,P) G for which there 

exists a solution (x(s),p(s)) of (14.51) with initial data (x(0),p(0)) G P, and (x(t),p(t)) = 

(M, P). In other words, T>t is the image at time t of the set P under the Hamiltonian flow 

Since P is a value function, it is differentiable along the minimizing trajectory (Corol¬ 
lary 4.1, [33]). Therefore, T>t C P; for any t > 0. Hence, since P is a graph, T>t is also a 
graph, for all t > 0. Moreover, T>t C Ps for all s < t. 

Let Dt be the projection of the set T>t onto the spatial component of the cotangent 
bundle T*L'^{P,W^), that is, all points M G L'^{P,W^) such that (M, VP(M)) G P*. 

Lemma 4.2. If Mi G Dt for some t > 0, then M 2 G Dt, for all M 2 ~ Mi. 

Proof. Fix Ml G Dt. Thus, Mi is a differentiability point of U and (Mi, VP(Mi)) G T>f 
Since U is periodic and invariant under measure-preserving transformations, by Lemma 
SH we have that U is also differentiable at M 2 . Furthermore, there exist Gn G G and 
Zn G L|(/;M'^) such that Mi o Gn + Zn ^ M 2 in the strong sense. Denote by M„ := 
MioG„-|-Z„. Recall that the gradient of a convex function is continuous at all points where 
it is defined, see |2|. Then, we have that VP(M 2 ) = lim VP(M„) = lim VP(Mi) o Gn- 

n^oo n—)-oo 

Because (Mi, VP(Mi)) G P*, there exists a minimizing trajectory x such that (x(0), p(0)) G 
P and (x(f),p(t)) = (Ml, VP(Mi)). Consider the trajectories y„(s) = :x.{s)oGn + Zn and 
q„(s) = p(s)oG„. Due to the rearrangement invariance and periodicity of the Hamiltonian 
He, we have that (y„,q„) solves (14.5p with terminal data (yn(f),<ln(t)) = (M„, VP(M„)). 

Let (y, q) G ([0, tj; L^(/; be the solution of (14.5p with terminal data (y(t), q(f)) = 
(M 2 , VP(M 2 )). Note that (y, q) is well defined since the existence of the solution for all 


14 


times is guaranteed by the fact that the right-hand side of (14.5p is uniformly Lipschitz in 
(x,p). 

The solutions (y„,qn) to (|4.5D have terminal data (y„(t), q„(t)). This data converges, 
in the strong sense, to the terminal data (y(t), q(t)) of another solution (y, q) of the same 
system. Therefore, by the stability of ODEs we obtain that y„(s) —)• y(s),q„(s) —>■ q(s), 
uniformly in the interval [0,t]. But this means that y„(0) = x(0) o Gn + Zn converges 
strongly to y(0), hence y(0) ~ x(0). Then, by Lemma l4.ll y(0) is also a differentiability 
point of the function U. By the continuity of the gradient, we have 

q(0) = lim q„(0) = lim Vf7(y„(0)) = V[/(y(0)). 

n—>-oo n—)-oo 

This means that y is a minimizing trajectory starting at the differentiability point y(0). 
Therefore, (M 2 , Vf7(M2)) = (y(t),q(t)) G Vt or, equivalently, M 2 G Dt- ■ 

Lemma 4.3. For every t > 0 one has that Dt = 

s<t 


Proof. Suppose M G Dt. Then, there exist points M„ G Dt such that M„ —)• M. Because 
Mn G Dt, U is differentiable at M„ and {Mn,'VU{Mn)) G Df Furthermore, there exist 
minimizing trajectories x„ such that (x„(t), p„(t)) = {Mn,VU{Mn)) and (x„(0), p„(0)) G 
D. Since x„ is a minimizer, the Lagrangian L satisfies the assumption viii), and 17 is a 
terminal cost function (as well as a value function), there exists a constant C depending 
on time t such that 

C/(M„ + H)> UiMn) + {VU{Mn),H) - C\\Hf, (4.6) 

for all H G L^(/;M‘^) and all n. Because U is Lipschitz, the sequence {V17(M„)} 
is bounded. Consequently, it has a weakly convergent subsequence with a limit P G 
L^(/;]R‘^). Hence, by passing to the limit in (14.61) . we obtain that 

C/(M + H)> U{M) + (P, H) - C\\Hf, 

for all H G L^(/;M‘^). Therefore, P belongs to the subdifferential D~U{M). Due to 
the semiconcavity of U, the superdifferential D'^U{M) is non-empty. Consequently, U is 
differentiable at M and P = \/U{M) is its gradient. 

By the continuity of the gradient, we have that \/U{Mn) —)• VU{M) in the strong 
L 2 sense. Next, solve (14.51) with terminal data x(t) = M,p{t) = 'VU{M). We have 
that (x„(t), p„(t)) —)■ (x(t),p(t)). Hence, x„(s) —)• x(s),p„(s) —)• p(s), uniformly in the 
interval [0, t] by the stability of solutions of ODEs. Furthermore, 

P(x„( 0 )) = f Pc(x„,x„) + P(c)ds-F P(x„(t)). 

Jo 

Thus, by passing to the limit, we obtain 

P(x(0)) = f Lc{'x.,±) + H{c)ds + U{'x.{t)). 

Jo 

Consequently, x is a minimizing trajectory. Since U is differentiable at all points of the min¬ 
imizing trajectory, except, possibly, at the starting point, we obtain that (M, VP(M)) G 
Vg, for all s < t. Therefore, M G fj so C fl 

S<t S<t 
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Now, we claim that P| C Dt- Suppose M ^ Dg or, equivalently, {M,VU{M)) € 

S<t S<t 

Pi T>s. Then, for every 0 < s < t there exists a minimizing trajectory Xs(r) such that 

S<t 

(xs(s), P 5 (s)) = (M, V[/(M)). Let (x, p) be the solution of (I4.5p with data (x(t),p(t)) = 
(M, V17(M)). By the uniqueness of the solution to (14.51) . we have that (xs(r), Pg(T)) = 
(x(r + t — s),p(r + t — s)), for any s < t. Therefore, the trajectory x is a minimizer 
for any starting point (x(t — s),p(t — s)). Consequently, (x(2t — s),p(2t — s)) G Vt- So 
x(2t — s) G Dt, but x(t) = lims_).tx(2t — s). Hence, M = x(t) G Dt- H 

Corollary 4.1. If Mi G Dt and M 2 ~ Mi, then M 2 G Dt. 

Proof. The proof follows from Lemmas 14.21 and 14.31 ■ 

Corollary 4.2. For every t > 0 one has that Vt = 

S<t 


Proof. For any {M,P) G Vt, we have that P = VU{M) and M G Dt. Thus, by Lemma 
1131 M G n L»s. Hence (M,P) = (M,VC/(M)) G p Vg. 

S<t S<t 

On the other hand, if {M,P) G P Vg, then P = VU{M) and M G P Dg. Therefore, 

S<t S<t 

from the Lemma [4.31 we have that M ^ Dt. Consequently, there exist Mn G Dt such that 
Mn —>■ M. Because M„ G Dt, the function U is differentiable at Mn and (M„, WJ{Mn)) G 
Vt. By the continuity of the gradient, VU{Mn) \IU{M) in the strong L?' sense. Then 
{Mn, VU{Mn)) (M, VU{M)) and (M, P) = (M, VU{M)) G A- ■ 

Lemma 4.4. The set n A is non-empty. 

t>o 

Proof. Since all the sets Vt are graphs, the statement in the lemma is equivalent to 

Doo = f]Dt^t 
t>o 

From Lemma 1131 we obtain that Poo = P Dt. The sets {Pi}t>o are closed nested sets. 

t>o 

Consider projections of At onto SS'^ through the projection operator vr (see S). 

Due to Corollary 14.11 the sets Dt contain only full equivalence classes with respect 
to the equivalence relation ~. Since the sets Dt are closed, the sets At are also closed. 
Additionally, they are compact, because is compact. Accordingly, they have a non¬ 
empty compact intersection 

Acx) — At. 
t>o 

Therefore, 

Poo = 7r"^(Aoo) + 0. 


Now, we have all the prerequisites to prove our next main result, Theorem 11.31 
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Proof of Theorem I j.,91 Consider the set 


h? = {M,-DpH,{M,P)) ; (M,P) G f| A I C TL\P,R^) 

[ t>o J 

Since P| Pj C is invariant under the Hamiltonian flow, Q is invariant under 

t>o 

the Euler-Lagrange flow. 

The projection operator vr is continuous, and the set Aoo is compact and hence closed. 
Therefore, the set Doo is closed. Since the gradient of U is continuous on the set of 

differentiability, we obtain that n A and H are also closed. ■ 

t>o 

From Lemma 14.41 it is straightforward to prove the existence of two-sided minimizers 
of the Lax-Oleinik semigroup. 

Proof of the Corollary \L^ For every point M G Doo, consider the minimizing trajectory 
X that passes through M. ■ 

The existence of weakly invariant minimizing measures on the tangent space of V{T'^) 
was shown in [28]. Subsequently, in |9|, the author established the existence of invariant 
(or strongly invariant) minimizing measures on TLp' ([0,1]). Here, we settle the remaining 
question, namely the existence of strongly invariant measures in for all d > 1. 

For that, we extend the methods introduced by Fathi in [T6| to the infinite-dimensional 
setting. 

Let 21 be the Borel cr-algebra of the subsets of Ao^- Define 

D = 7r“^(2t) = {7r“^(H) ; A C Aoo}- 
Note that 3 is a cr-algebra of subsets of Doo- For every C G 3, set 

Be = {(M, -DpHoiAI, VU{M))) ; M G C} 

and consider 

25 = {He ; C G D} . (4.7) 

25 is a cr-algebra of subsets of H. 

Lemma 4.5 (Riesz Representation Theorem and Compactness). We have that 

i. for every linear bounded functional Q acting on the set of continuous rearrangement- 
invariant functions F : H —>■ M, there exists a measure g, on (H, 25) such that 

Q{F) = I Fdfi; 
n 

a. the space of probability measures on (H,25) is a narrowly compact space. 
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Proof. i. Let / : Aoo ^ M be a continuous function. For {M,N) G Q, let Ff{M,N) = 
Ff{M,—DpHc{M,'S7U{M))) = /(7r(M)). Then, Ff is rearrangement invariant and 
continuous. Define 

q{f)=Q{Ff). 

q is a linear bounded functional acting on continuous functions / : A^c —>■ K- Since 
Aoo is compact, the Riesz Representation Theorem yields the existence of a Borel 
measure u on Aoo such that 

Qif) = j fdv. 

^oo 

Consider the measure 

fiiBc) = i^iTTiC)), C G Doo. (4.8) 

Then, /r is a measure on (D,iB). Moreover, for every rearrangement invariant and 
continuous T : D ^ M, we have 

J Fdfi = J fdu, 

^oo 

where /(a) = F{M, —DpHc{M,'VU{M)), for some M G 7r“^(a) and all a G Aoo- 
Note that Ff = F. Hence, we have that 

J fdi^ = q{f)=Q{Ff)=QiF). 

■^oo 

Consequently, the previous two identities give 

Q{F) = J F{M,N)dfi. 

Q 

ii. Suppose {//«} are probability measures on (H, *B). Consider the sequence of measures 
r'n given by (|4.8p . Since, r'n are supported on a compact set Aoo, they form a narrowly 
precompact sequence. Hence, there exists a measure Voo such that Un —^ i^oo narrowly. 
Now, define Hoo via (I4.8p . Then, it is straightforward to verify that fXn converges to 
^oo narrowly (tested against continuous rearrangement-invariant functions). 


Let X be a solution of the Euler-Lagrange equation (12.41) . Dehne 

cl>(t; M,iV) = = (x(t),i(t)). 

Definition 4.1. A measure ft defined on (H,*B) is invariant under the Euler-Lagrange 
flow (invariant, for brevity), if for every t > 0 


h = 4>(t;-,-)#f^- 
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Proof of the Corollary li.M The finite-dimensional analog of this statement is presented 
in [TU] (Corollary 4.4.9). The proof extends to the infinite-dimensional setting without 
significant difficulties. Hence, here, we give the main components of the proof. 

The proof of the inequality 

Lcd/i > —H{c) 
ft 

for invariant measures extends to the infinite-dimensional setting with no changes. 
Next, we prove the existence of minimizing measures. Fix a point Mq € H. Consider the 
linear bounded functional 

t 

I F(4)(t;Mo,iVo))dt, 

0 

where Nq = —DpHc{Mq,\/U{Mq)). From Lemma 14.51 we have that there exist measures 
on such that 

t 

I Fdiit = ^ I Fms-,Mo,No))ds 

ft 0 

for all continuous rearrangement-invariant functions T : H —>• M. The family of measures 
{^i} is precompact due to Lemma IT31 Hence, there exists a measure ;Uoo and a sequence 
tn ^ oo such that fioo narrowly. In other words, 

in 

[ FdyLoo = lim [ Fd^t„ = lim ^ [ F{^{s-, Mq, No))ds, 

J n^oo J n^oo tn J 

ft ft 0 

for continuous rearrangement-invariant test functions F. Let /i > 0, we have 

in 

J Fmh-^s-Mo,No)))ds 

0 
in 

J Fms + h-,Mo,No))ds 
0 

J F($(s;Mo,iVo))ds 

h 
in 

J Fms;Mo,No))ds 
0 

= J F{M,N)dia^. 

ft 

Therefore, /Too is invariant under the Euler-Lagrange flow. 


f F{^{h]M,N))dfioo= lim ^ 

J n^oo tn 


= lim — 

n—>-oo tn 


= lim — 
n^oo tn 


= lim — 

n^co tr 
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Furthermore, set F = Lc and observe that 


/ 


LcdfjjQQ 


lim — 

n—>-00 tn 


I L,ms;Mo,No))ds 

0 


U{Mo) - U{^^{tn]Mo,No))-tnH{c) 

tn 

-H{c). 


The previous identity gives that ^oo is a minimizing measure. 
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